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ABSTRACT 

The paper described the Input, Process, Product, and 
iMpact (IPPI) lodel in preparation for a 1972 Hanageient Inforiation 
Systea for Occupational Education (HISOE) planning conference. The 
IPPI sodel is designed (1) to provide a structure for integrated 
State' and local decision-making vithin occupational education and for 
decision-related descriptive inforaation which accounts for reality 
by decision types within the lodel, and (2) to provide a framework 
for analysis of relationships between inputs and process with product 
and ispact. The system also peraits decision-aakers to simulate the 
interactive effects of the total systea over tiae. The aodel 
describes the totality of occupational education;* links to the larger 
world occur with input and iap&ct. The paper establishes soae / 
differentiations, distinctions, and definitions, and thereby provides^ 
a structure for project developaent which not only stipulates 
developaental tasks, but ties consultants and staff to developaent in 
a functional way. Bight tasks are described in the paper, related to 
space differentiations, variable selection, instruaentation, the 
saaple, the indorsation systea, analysis types, siaulation, and other 
information needs. The final section of the paper suggests an 
integrated procedure for task development, including a schedule for 
the planning conference. (Author/1 J) 
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The IPPI model is designed (1) to provide a structure for Integrated 
state and local decision making within occupational education and for deci- 
sion-related descriptive information which accounts for reality by decision 
types within the IPPI model, and (2> to provide a framework for analysis of 
relationships between Inputs and process with product and Impact, Analytical 
Information feeds back Into the decision-making process such that prediction 
for future product and Impact can be empirically estimated. The system under 
construction also permits decision makers to simulate the Interactive effects 
of the total system, particularly Inputs and process on product and Impact, 
over time. Essentially the IPPI model describes the totality of occupational 
education, and links to the larger world occur with Input 2fnd Impact. 

The purpose of this paper Is to establish some differentiations, 
distinctions and definitions and thereby provide a structure for project de- 
velopment which will not only stipulate developmental tasks but will tie con- 
sultants and staff to development In a functional way. The final section of 
this paper will suggest an integrated procedure for task development. Includ- 
ing a schedule for the February sixteenth conference. 

TASK I 

SPACE DIFFEREMTIATIONS OVER AMD WITHIN MODEL ELEMENTS 

A fundamental task Is to mark off with logically related verbal sym- 
bols the space within each of the IPPI model elements. These boundaries must 
account for the total conceptual space within each model element and at the 
same t I me^ provide for variable Information types within each area* The total 
IPPI model accounts formal I occupational education. Within each IPPI element 
are discrete spaces which dan be filled to various levels. Space within each 

4 



IPPI element Is defined by specific variables which can be determined by de- 
cision makers and change over time. Levels describe the degree or extent to 
which these within element variables exist. Definitional decisions establish 
•expectation standards for each of these subspaces within IPPI elements, while 
descriptive Information describes the actual level within each IPPI subelement, 
by variables. In general, levels are established by rates, rates are a func- 
tion of decisions and other phenomena. The level and rate relationships will 
be discussed In more detail In Occasional Paper #3. 

The following Is offered as a tentative designation of space within 
each of. the IPPI elements: 
Input Space 

Input space is divided into two sections, one Is simply entitled 
students and the other capital , meaning dollars. Student space Is divided into 
two sections, one is labeled, student characteristics and the other student 
descriptions . Student characteristics are further divided into five spaces, 
which are: (I) capabilities ; (2) Interests and attitudes ; (3) personal Itj^; 
(4) physical attributes ; and (5) biographical Information . Student descriptions 
are subdivided Into four spaces, which are: (I) family chara cteristics; (2) 
peer characteristics ; (3) neighborhood characteristics ; and (4) city or town 
characteristics . Information about students which Is categorized as Input de- 
scribes characteristics and descriptions of students prior to entrance Into an 
occupational education program. Perceptions by students of process Is cate- 
gorized under human factors within the process element of the IPPI model. 

Capital Is divided Isnto four categorles| (I) local ; (2) state; (3) 
federal; and (4) other . Expenditures must at alU times be Identifiable by 
these distinctions. ' i 
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Figure I outlines Input space as herein described: 



FIGURE 1 
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Pirocess Space Differentiations 

Process space differentiations are difficult to determine. Monograph #1 

differentiated between structural and organizational process space as those which are 

« 

eosy to manipulate and those which are difficult to menlpulatei This Is a useful 
dif ferentIatIon> however, limited. Another problem not considered In Monograph #1 Is 
that variables are not one or another across the management hierarchy. For example, 



time Is total lymenipulatable at the state level and hardly manlpuiatable at 
the classroom level. A further problem in defining process space Is that some 
variables are constant across programs, while others are unique to particular 
configurations of behavioral objectives sought. The following conception of 
prbcess space Is offered as a first attempt to usefully differentiate this 
space for description and analysis. Due'to the complexity of this model ele- 
ment. Figure 2 Is presented as a prel Imlnary map of process space and refer- 
enced by the discussion below. 

The focus for process space Is the Instructional event, which Is de- 
fined as the totality of a specific teaching and learning experience within a 
program. (There are simple and complex Instructional events). Process Is 
simply defined as the totality of Instructional events across all occupational 
educatloa programs. Although all pr;ocess space Is related to Instructional 
events, levels may be analyzed separately across factors. 

As displayed In Figure 2, process space Is conceived as two dimensional 
with columns representing factors and rows depicting levels. Levels will be 
dealt with first as they are relatively uncompJ Icated* Basically, two levels 
are conceived; (I) the state level and (2) the local level. The state level Is 
described as over-all schools and Includes the following role Incumbents: 
(l) policy makers; (2) administrators; and (3) support personnel. The local 
level provides for a separate administration over all schools and a distinct 
administration over all programs within schools. In addition, It Includes 
role Incumbents at the within program, within school level. This Is, of course 
a very truncated representation of process space, as considerations must be 
made for each program. Levels allow consideration of factors as they are de- 
veloped and exist within the hierarchy. 
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Three comprehensive factors are conceived to represent alf of ^ 
process across alf levels: (I) human factors; (2) physical factors; and (3) 
organizational factors. Human factors Include the characteristics and be- * 
havlors of all role Incumbents Mn the process, with the exception of student 
characteristics and descriptions which are considered Inputs. Character- 
istics Include: (I) capabilities; (2) interests and attitudes; (3) personal- 
ity factors; (4) biographical Information and (5) physical data. Behavior 
Includes the totality of what role Incumbents do within the process and Is 
subdivided Into: (I) decisional behavior; (2) operational behavior and (3) 
perceptual behavior. Decisional behavior Is described as goal or standard 
setting by role Incumbents across factors and down levels. Standards and/or 
goals are not only set for physical and organizational factors but also by 
human factors for human factors. Operational behavior describes what role 
Incumbents do within the process. This Includes: ("^ policy-making behavior; 
(4) teaching behavior; and (5) learning behavior, at all appropriate levels 
In this hierarchy. Perceptual behavior describes awareness of role Incum- 
bents within process. Such perceptions Include factors usually described as 
environmental, Including climate and press perceptions. 

i 

Physical factors are uncomplicated to describe, but require the de- 
velopment of a classification system. They are divided Into two categories, 
structural and Instructional. Structural factors are those that can be de- 
scribed es housing a program or programs, while Instructional factors de- 
scribe non-housing elehients that are clearly related to an Instructional 
event(s). Typically, structural factors will exist over all programs within 
a school, and Instructional factors can either be over all programs or unique 
to particular programs. Physical factors are determined by human factors. 

-6- 
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Determinations for physical factors are made at various levels within the 
hierarchy^ ♦ 

, Organfzationa I- factors describe the configuration of human factors, 
physical factors and time which constitute instructional events. Human fac- 
tors, physical factors and time are organized by human factors at various 
levels In the hierarchy separately or in combination across these three 
categories. The column entitled Organizational Factor Interactors Is de- 
sfgned to Include these combinations. 'Organizational factors are differen- 
tially determined at various levels in the hierarchy. 

Classifying process variables within the designated process space 
of Figure 2 will allow the description of instructional events to Include 
specific reference to factors and levels. Further, constraints on the deter- 
mfnatlon of Instructional events at tower levels of the hierarchy are made 
apparent by this scheme. Also, as Implied "above, such a display of Informa- 
tion permits an analysis of Impingement, by level, on Instructional event(s). 

The tool to make these 'determinations Is yet to be developed, how- 
ever, a coding system wM I allow Instructional events to be referenced by 
specific process space. Classes of instructional events will be determined 
which describe groups of teaching- learning experiences* Given the nature of 
publ tc education, this challenge Is not nearly as difficult as It might ap- 
pear, since the similarity of Instructional events over programs and schools 
ts hypothesized as being enormous. 

An example of an Instructional event might be the teaching and 
learning of Fortran programming by a class of students within a particular 
school. Such an Instructional event could be described In terms of con- 
straints that exist as a result of prior decisions by the hierarchy on the / 
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teaching- learning process* It could be further described by the character- 

* 

Istlcs of the teachers and learners^ the operational behavior of the teachers 
and learners, and/or the perceptions of both groups toward the usefulness of 
the task* Further, this instructional event could be described by the physi- 
cal factors which exist, well as the organizational pattern of human and 
physical factors and time brought to bear on this particular experience. 

The above scheme for classifying process Is being further devel- 
oped currently, and will be presented In more detail at the February sixteenth 
corrference. It will also be the subject of an Occasional Paper, At this 
point. It should be noted that each subdivided area of process space can be 
described by one or several discrete variables which can exist or not* If 
they exist, they exist to some degree and can be described. The purpose of 
descriptive information types is to stipulate the degree to which these 

I 

variables exist by Instructional event(s) within programs, within schools and 
across schools. Such information will allow for Interactive analysis across 

i 

IPPI categories. 

.This scheme seems to lend itself to economic analysis, as columns 

! 

and rows can be costed out and summed across. At any rate. It should give 
the economists among us something to consider, as cost product data, as de- 
scribed in Monograph #1 requires a rather careful analysis of expenditures 
^within and across programs* 

Product Space Differentiations . Product space differentiations are relatively 
straightforward. Basically, occupational education Is conceived as purpose- 
ful oapabMlty production activity. Capabilities can be described as psycho- 
# 

motor. Intellectual or cognitive, and affective, (Some consideration should 
be given to personality.) Flgurd 3 represents an tntt4al attempt to mark 
off product space* 
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FIGURE 3 
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MfssJng In thfs particular conceptual ization are considerations for summing 
capabilities within and etcross programs^ It should be pointed out, however, 
that product space will include a stipulation of capabilities by total human 
bejng within programs and across schools^ although considerations will be made ^ 
for analysis of specific capabi Mties* The purpose of this sect lop is not to^ 
examine data connect iveness Within the sample nc^r is It to go beyond the ; 
straightforward marking off IPPI element space. 

\ ■ ■ ^ 

Impact Space DIff erentlations > Impact space differentiations are difficult to 

determine. The Initial differentiation of Monograph #1 is rather uncomp I ica ted; 

i 

i.e., self and society , tt isnH particularly difficult to stipulate logical 
differentiations within self Impact space. The following areoffered as mean- 
ingful and useful definitions within self-'impact space: (1) self as a worker ; 
(2) self as a contributor to society ; (3) self as a fulfilled person ; and (4) 
♦ self 1 1 festy I e characteristics^ Impact self space can be further subdivided. 



For example, self as a worker can be conceived to include: job satisfaction^ 
job satisfactorlness , occupat t ona I product t y \ ty ; and occupational growth . The 
other three self categories can be similarly marked off, and variables can be 

4 

selected to describe this space (See Figure 4), ? 

Differentiations within society space require considerably more 
ludacity to suggest. Further, society should be conce Ivied i n 'geographic 'space, , 
i.e., local society, regional society, state society, national society and ; 
World society.. Obviously, suth a consideration suggests a two-way tdrble, 
wth tlie columns stipulating impact spac^ elements while the rows represent 
geographical areas,. > However, gec^graphica I differences wilt not be treated in 
t>is presentation, but will be in future development;. 

Societal space can be divided Into ecorkxnic and non-ecQnomlc sUb- 
5>gce. Economic space can be further subdivided Into productivity and non- ^ 
productivity J Product! v ity' can be described In terms of empi oyment, produc- 
Hon of goods and servijces -arid, tax revenues . Non-^productivity could be de- 
scribee^ as w^l Wre , unemployment and perhaps rehabll itation costs* These are 
af l quantifiabl:^ by d6l lars and thereby provide a .measure of impact which can 
be described I ni terms of cost. Much of this Information can be obta Ined by 

f. " ; ;'.„■', ■ . ^ ^ 

summing over self data ibf impact space. >w 

\ NoH-economiC' Impa<;t space is considerably more difficult to sub- 

idivide. The foltiowing Is offered as a suggested pl:5y to differentiate non- 
ecbnomici sociiBty.sDace. Non-economic-soclety-impact space essentially In- 
cludes rthqse desirable .societal elements which consitute the "good life" as 
determined by the value system of a particular group within a particular 
soclesty. Nonreconomic society Impact space could therefore be differentiated 
in terms of concepts which extend from societal values, and variables can be 



-10- 



14 



selected which could estimate the level'-of those subspaces. For example, 
one could divide this subspace as follows: (I) orderly society; (2) equa t 
opportunities within society ; (3) free enterprise; (4) strong family system ; 
ant* <5) self government . The next step Js to select variables that describe 
this space and to measure levels within -this space. For example, a variable 
that could describe equal opportunity might be a representative racial mix 
within occupations. Decision makers could, estabi ish variables and levels of 
expectation within Impact space and could redistrict Impact space, it Is 
hoped, however, that the model will anticipate most impact space differenti- 
ations, and that decision marking will concern itself with variable determi- 
nation within stipulated Impact space. • 

It should be noted at this point that occupational education makes 
contact with the larger society through input and impait elements. The infor^ 
mation system and analysis within this system must deW with education as a 
subsystem of a' larger universe, and stipulate the contact points at Input and 
impact, such that these relationships can be dealt with. It is too easy to 
consider education as a closed system, and we must be careful to avoid such 
parochialism. 

Summary 

— _ .-if 

The task that remains for differentiating fpPI model space is to 
expand these differentiations to the point that fo'Q] model space faithfully 
-and usefully represents reality for the purposes of description, ' analysis and 
management. The accomplishment of this goal requires the joint efforts of 
both the staff and consulting team. Therefore, this wilt be an early agenda 
item during the February sixteenth conference and specific responsibility for 
this task will be assigned to members of the staff. 

-12- 
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TASK 2 

VARIABLE SELECTION WITHIN SPACE DIFFERENTIATIONS OF MODEL ELEMENTS 



This Is a somewhat uncomplicated task and involves a selection of 
variables with in system space differentiations. At the beginning thecal 
variables will be determined by the project staff and consultants, bui the • 
system must be sufficiently flexible to deal with new variables over time. 
This task interacts with both analysis and Instrumentation, two tasks to be 
discussed below. 

System space is described as a summation of the variables within 
that space, or subspace, administratively determined or otherwise. Alt vari-- 
ables whjch exist and are measured must be classified by predetermined system 
space. This requires a fairly complex coding and classification system for 
system space, within space variables and for measurertient Instruments. 

Some examples of variables within system space ace as follows: 
capabilities within student characteristic input space could be described by 
a list of aptitudes ranging from musical to mechanical; white family charac*- 
terlstics within input student description space could be described by a vari- 
able measuring father's attitude toward, risk taking. Decision makers sefect 
variables within system space and stipulate the level at which these variables 
should exist. The information system describes the variables that exist 
within system space, and attempt to estimate relationships within system space 
In terms of these variables. There is obviously a dependency of variable de- 
scription on^ instrumentation. This question Will be examined * be low. However, 
it should be pointed out that the system will be developed so that It can 
begin to function with limited variables wtthin system space, but It will be 

-13- 
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designed In such a way that ft can accommodate more complex descriptions of 
system space. 

Variable selection depends upon system space differentiation. It 
IS anticipated, however, that space di ff erontlations will be sufficiently de- 
veloped by February sixteenth that the conference can spend some time stipu- 
lating varlab-les within system subspace, A particularly prominent bias is 
that we have a responsibility to get the system operating with *^stralght- 
forward" variables and grow Into complexity. Variable selection or determi- 
nation within system space will be a staff function or task to be directed by 
those responsible for system space development. This seems a log lea T require-^ 



ment as a result of the interaction between the two tasks. 

' * ^TASK 5 

INSTRUMENTATION 
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Instruments aX^e described as those devices which measure system 
space. System space Is a summation of variables within system space, and 
Instruments must be developed tct^detect the degree to which variables exist 
within system space. Further,- these Instruments must be cataloged In a way 
that references wlthft^ IPPI element system subspace, and at the same time de- 

V 

♦ /. * 

scribes the error with which system space Is measured, by Instrument. Ob- 
viously, some varfabPes are extremely difficult to |^easure, while others are 
^t ra I^h tf b r wa r d • ^iTi nttsTiy^llisl^c^s^, ther^ wel T developed Instruments to 
measure variables. In general, the non-psychological variables are fairly 
easy to detect and can be described quite accurately tn an uncomplicated way. 
Some Instruments for some psychological variables have been well established 
and can be easily adapted to the system. However, many psychological vari- 
ables are difficult to detect and Instruments to estimate their existence are 

c 
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either non-extstent or very poor. As was previously Indicated, It Is the 
current bias t4 develop an operational system froin variables that cah cur- 
rently be detected, and to provide within the system the flexibility to treat 
new Information as It evolves. 

Another Instrumentation requirement Is to develop communication 
devices to record the stipulation of goals and standards by decision makers 
at various "levels for IPPI elements. These instruments must, of cours6^ bo 
consistent with the elements of the total system, and allow for clear cdmrju- 
nication across levels. Analysis of state information, emanating from both 
census and sample data, will provide a description of reality in terms of 
standards and objectives. Such a description will be on a state-Wide basis, 
and wil*Knbt be available by LEA goals and standards within the system. This 
avoidance development is designed to protect and encourage 'diversity within 
occupational education in Massachusetts. 

Currently, a file of instruments Is being developed by the project 
staff for atl elements within the information system, with particular atten- 
tion being paid to process space. As a matter of fact, we are developing a 
fairly comprehensive test file. To repeat. It is our bias that we should 
begin the system with existing measures and grow to developing new measures 

over time. * 

Instrumentation is a vital concern and will be a topic for dis- 
cussion at the February sixteenth conference. Since, in part, the variables 
to be selected which describe system space are somewhat limited to -fliose that 
are currently measurable, a determination of these Instruments as well as a 
description of the constraints of these tools is a high priority Item. There- 
fore, an Occasional Paper Is requested on this topic which deals with the Issue 
separately, and as It Interacts with analysis and system space. . 

19- 



TASK 4 



THE SAMPLE 

^ Preliminary consideration of the sample, as well as sample popu- 
lation relationships, were offered In Occasional Paper II. Nonetheless^ the 
determination. of the sample, as well as sample population relationships 
through data and Instrument connectors Is a task. As stipulated In Occasion- 
al Paper #1 and Planning Chart #1, the sample will be by program and over 
specific dimensions of occupational education; Including geographical areas;' 
school types and levels; and student types. The task can be described as se- 
llfetlng and maintaining a sample(s) such that analysis and descriptive data 
^for both the sample and the population are connectable, within the constraints 
of the systemT^There are sam problems that should be considered by the staff 
and consulting team concerning the sample and the population* Given the 
effect of these concerns, an Occasional Paper will be commissioned to describe 
sampling procedures In detail, as well as specifications for sample popula- 
tion relationships, within system constraints. 

Two major considerations for thwieample are; (I) Implications for 
analysis; and (2) the so-called camera effects. The first one Is methddol- 
oglcal, and will be treated briefly during the February sixteenth conference. 
The second problem Is developmental, and Involves an anticipated contaminating 
effect of measurement on the performance of human factors wTthtn the sample* 
A data requirement that makes the sample selection somewhat complex Is that 
longitudinal Information of students, over time. Is desirable. That is, the 
system seeks Information about particular students prior to entrance to 
specific programs, during the program, and after the program. 

-16- 
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Information can become Irreparably damaged unless some attention 
Is given to solving this problem, for example. If one focuses on the same 
'sample over time, the measuremenT experience Is very likely to contaminate 
th^ process. If, on the other hand, one selects a new sample each year, soon 
there will be very little to differentiate between the sample and the popu- 
lation. Consider the following: 

FIGURE 5 



» " — ■ • ' ' 

SAMPLE BY PROGRAM TYPE OVER FOUR YEARS 
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This figure displays samples over four years of time* 


Prior to the 



first year, students are considered as Input and observed. Programs Include 
manpower development' training, post-secondary, adult and secondary. Large 
boxes represent one year of time. At the end of four years, there Is Impact 
data for three and a half years of most MOT programs, two years for post- 
secondary programs, three years for adult programs, and only one for 
secondary programs. 
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Perhaps a solution to the problem Is to select a new sample at, 
the termination of the process experience for each separate occupational edu- 
cation type» This would allow a continuous flow of Information over time 
and guard against the testing effect. Of course, comparable control sampfes 
for each type must be simultaneously selected for cost Impact 'data* The con*- 
sequence of thls^ In terms of Figure 5, would be as follows: 

(4) MOT > At least eight separate waves of students 
wilt be processed, resulting in eight separate 
Impact studies. 

(2) Post--secpndary . Two* cycles would be treated, 
each cycle representing a sample, with two year 
follow up or Impact Information on the first 
cycle. 

(3) Adult . Since adult programs are displayed as 
one year programs, impact groups would range 
from one to three years, and the fourth sepa- 
rate sample would be under study. 

(4) Secondary programs ^ The second separate 
sample would be experiencing process examina- 
tion while the first sample is being studied 
from an tmpae4-per-spec+tve^.^ 

Except for Impact, only one IPPI element per occupational ^educa-- 
tton type could be under consideration at a tlme^ and no two schools ^Spld 
be contiguously examined. However, at the end of eight years over forty-six 
Impact studies would be required. 

Sample determinations are going to have to be made soon and the 
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above is offered to suggest the scope of the problem* Obviously, accom- 
modatfons are going to have to be made such that the amount of Information 
treated Is reasonable* The conference of the sixteenth will develop specific 
guidelines for sample development, and, as stipulated above, an Occasional 
Paper will be developed ciescrlblng a sample within the guidelines. 

TASK 5 
INFORMATiON SYSTEM 

The Information system Is a d^gscription of total model space pre- 
sented In Monograph #1 and developed to this point. It is helpful to think of 
the information system as a computer mddel, with two major capabilities: (I) 
storage; and (2> analysis. Another characteristic of computer systems Is a 
potential to examine manipulated and/or stored Information and determine 
further analysis needs from specified criteria. Further analysis could be a 
part of a fixed coinputer system or optional. Unplanned analysis, which can 
occur at specified Intervals, permits flexible examination of relationships. 

Three levels of the computer Information system can be distinguished* 
The fIrsT level is a description of the total population In terms of census 
Information available, which Includes; (I) anticipated and real, enrollments 
by program, by school type and level, by student type, etc.; (2) program com- 
pletors by the samo dimensions; and (3) relationships among these Information 
types, for example, average cost per completer, by program. 

The second levei of information is at the sample level, which not 
only describes levels within IPPI elements by information types, but presents 
a detailed picture of relationships among information types. The descriptions 
have been specified as data types A| to Ag, and, taken together, stipulate a 



corfiprehensfve explanation of system space* 

The third (evel of Information is prediction, frequently described 
as simulation or forecasting. ^ These Information types have not been devel- 
oped at this point, but provide an estimation of the future consequences for 
an array of alternative decisions. It might help to think of these Information 
types as. .."What would happen If—?" these predictions are based either on 
real or "manufactured" Information, appropriately labeled. As an example of 
forecasting, reconsider the IPPI model as follows: 
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A forecast at the scx:Iety level might be tor example: 
Given ; 

CD Specific student types; 
(2) Specific impact goals; 
Display ; 

(1) Product objectives within programs most likely to 
cfbtaln impact goals; 

(2) Least cost process to attain goals; 

(3) Impact of goal attainment on society. 
Or at the educational system level: ^ 

Given; , -^ii^ 

(I) Current product objectives within schools, geographical 

areas, and specif-ic-programs;- - 

Display : 

(I) Least cost process V3j-iable(s), (specify factors) to 
maintain current output, by student type. 
The information system must be thought of as both fixed and manlpU'- 
iJitable. Phase I of the system could be characterized as predominantly fixed, 
i.e., the description of IPPI levels, relationships among elemen*hs and re-- 
ports will be predetermined. However, ^the computer system will be conceived 
such that new analysis and report potential can be^lmultaneously developed 
and added to Phase I. The system will become Increasingly manlpulatabie over 
time. 

An Occasional Paoer describing fhe computer system is currently 
being written, which will describe developmental phases, it is important to 
conwunlctfte a development requirement at this point, the computer system wi I t 
become operational across the Commonwealth with Phase I, but is designed such 
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that growth and flexibhfty can be devbloped and Incorporated over time. 
* Finally, the system must bo concefved as an ongoing management tool for 
occupational education in Massachusetts and will be a crucial part of deci- 
sion making. The system* Is not to become an historical data storage contra po- 
tion, but, rather, an active and growing body of related knowledge which-- 
guides the action of those responsible for educational management. 

Since the computer system provides an excellent communication tool 
for development, it wll I be us^d as a way of describing development. There- 
fore, this task Involves developing models of the computer system which wiji 
structure our work, which will summarize our work, which will coordinate our 
work, and which will work. Occasional Paper #5 will preilminarlly describe 
the computer system and will be completed by the February sixteenth conference. 
System development will be an In-house function, under the general direction 
of Mr. Breslow. 

TASK 6 
ANALYSIS TYPES 

In general, analysis types are determined by the kind of outcomes 
sought, although it is acknowledged that analysis can precipitate unexpected 
results. Phase 1 development of MISOE Is to be characterized by fairly pre- 
determined ranges of outeomQ^and it is iherefore possible to stipulate anal- 
ysts types%*by outcomes sought. The purpose of this section is to describe 
several distinctions and considerations to serve as guidelines in determining 
analysis types. 

'"""^An important part of the Tebruary sixteenth conference will bo 
given oveV to analysis needs and four (4) Occastpnal Papers will 4m\ with 
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analysis requirements. It Is planned that by June of 1972, most of Phase I 
analysis needs will be resolved* 
Analysts Considerations 

As suggested above. Phase I of MISOE development is to be charac-^' 
terlzed by fixed analysis, based on prescribed data outcomes as described in 
Monograph #1 and Occasional Paper #1 (data types Dj - D4 and A| - Ae)* How- 
ever, even though Phase I Is considered as fixed, it I I a I low branchi ng or 
alternative analysis to occur, based on^ preconceived decision rules within 
contingency tables. Actually, three levels of analysis are distinguishable: 

(1) Entry level analysis is defined as first step analysis 
for all similar data types upon entry into the system* 
This analysis type tends to organize information for 

^ . further treatment, and (by definition) provides a basis 

for status reports^ which includes data types D| -04^ 
% and A), for both census and sample information. 

(2) 2nd level analysis is described as a fixed analysis type 
for all appropriate sample data required to develop ana- 
lytical data types ^2 A5. The chief characteristics of 
2nd level analysis are: (Da dependency on entry level 
analysis and (2) consistent or. similar analysis for all 
appropriate data. ^ 

(3) Contingency level analysis is described as fixed analysis 
which is performed on selected data. The decisions for 
selecting the data for further ana lysis are expressed in 
contingency tables, and only appropriate data is branched 
for contingency analysis. _ _ . _ * 
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~ All three fy^es "of Analysis" are to be Tncluded [n Phase I develop- 
ment of MISOE, and are described in more detail fn Occasional Paper #3, A 
fourth analysis type which Is not Included i^n Phase 1 development can be de- 
scribed as variable analysis^ which Is generally described as a within system 
provision for non-^predetermtned analysis. MtSOE, during Phase I development, ^ 
will have the capability of Incorporating new, fixed analysis types, either 
. entry level, 2nd level or continge ncy level, but will not be able to respond 
to "on line" commands to alter an analysis process. Variable analysis is a 
Phase 11 project. However, Phase I development does provide for variable 
status reports on data types within the system, "on line". 

Figure 7 offers a review of the several distinctions within 
- analysis types to this point. In genera!. It can be assumed that entry 
level analysis for census and sample data is comparatively uncomplicated. 
Second level analysis and contingency analysis are complex. At this point. 
It Is suggested that all analysis on census data be considered entry level 
and that second level and contingency level analysis be reserved for sample 
data. . 

A distinction between economic and nOn-economIc analysis is Impor- 
tant to consider. Typically, analysis can be (differentiated as one or the 
other. However, an additional analysis requirement of this system Is that 
economic analysis permeate all analysis, such that cost product and cost impact 
analysis can be regularly obtained. This requirement should force the develop- 
ment of applied analysts types. 

Historical trend analysis by data type is relatively straight- 
forward, and provides a basis for projection as well as analysis, over time.. 
Provisions for storing and reporting such Information are described in 
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Occ¥sl6nar"Paper #37 IT TsTneferenced^ tn the analysis section because^ j 
Specific analysis is required to meet this need. Historical trend analysis 
spans all data types and all analysis I eve! si ] 

Finally, analysis requirements for simulation could be described 
as contingency level, trend analysis^ CI ear I y^^ simulation demands complex 
anityslsr. During Phase I development, simulatfpn will not be variable, but 

restricted to predeter mined outcomes. Examples ha ve been provided elsewhere 

In this paper, and are discussed in Occasional Paper #3* Further, a>speclflc 
Occasional Paper or simulation Is to be developed. The objective during Phase 
I developmeiit' of MISOE Is to field test and make operational a tcomprehenslve 
but fixed simulation model. Phase H of MISOE will develop a variable anal- 
ysis potential for simulation, as well as the entire system. 

Conclusion 

The analysis task Is relatively straightforward. The first phase 
Is to develop a fixed analysis system, which has the capability of accepting 
.more fixed analysis and, eventually, variable analysis. The first conference 
is designed to focus on analysis, and Occasional Papers by the consultant 
staff will treat Phase I analysis needs. The permanent staff has a responsl- 
bllity to synthesize specific analysis specifications Into an analysis process, 
to be construct tveiy crl+iclzed by the consultant staff in the Spring of 1972. 
and finally adopted into a system. 

TASK 7 
SIMULATION 

Simulation Is simply described as providing a capability to explore 
_tJhe future Imp Ifcat^hDn^ Of current decisions given specific assumptions and 
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informot-ion* MISOE wM I Include a slmulatlcn eapabH ity which wlH- be f lixed- 
durlng Phase I, but become variable during Phase 11. 

Examples of simulatfon have been offered In an earlier section 
(Information System) and wilt not be repeated here. It should be pointed out 
that future trend analysis Cslmulation) can be reviewed In light of historical 
analysts, which not only provides a tool for making better the predictions^ 
but a basis for Judgin^^^ ^^ usefulness of simulation, 

A special paper on simulation is being developed, and therefore 
Uttle attention will be devoted to this task now. In general, simulation 
data turns out to be probability statements about specific outcomes over time, 
based on explicit data and assumptions. Simulation typically deals with the 
long term consequences of decisions. MlSOE will focus on simulation fCr pre-- 
determined outcomes of obvious significance, with particular emphasis on the 
relationships between the long term consequences of Input and process on 
product and impact, ' 

The tasks In simulation development are straightforward: (1) to 
determine the specific forecasts to 6e made; and (2) to develop the analysis 
tools.. Considerable attention will be paid to simulation during the February 
conference, and within the Occasional Papers dealing with analysis. It Is 
anticipated that the Occasional Paper focusing on simulation will offer a clear 
blueprint of Phase 1 simulation development. 

TASK 8 
OTHER INFORMATION NEEDS 

MISOE is a closed Infbrmatlon system, which Includes a potential to 
Interface with other .relevant data. So-called other information Is particularly 



crucial for Impact analysis. ~ 

This Information includes: (I) manpower needs Information; (2) 
societal data which js likely to describe Impact; and (3) occupational "prac- 

tice data which would tend to validate the ^object I ves*^ sought by schools wlthfn 

* .* 

a state. Occupatltfnal practice Information would Include cotivertlble ?nfor- 
nation from Project TALEt*!! and Information being developed by Proj^t CAREER. 
Further, all Impact analytical data types of MISOE provide. an estIn«t}on of 
these relationships. 

Other information is pari"fcu!arly crucial for Impact analysts and 
slwulation. An Occasional Paper describing these requirements for external 
and related data will be developed by June of 1972, so provisions for obtaining 
IPnkages with Interfaceable data can be estibl Ished. It should pointed out 
that Project CAREER Is a part of MISOE, and has a potential to provide arj 
tnterface with Project TALENT. All Department of Labor manpower data is con- 
notable to MISOE, If coded by th^;Dlctlonary of Occupational Titles, Provid- 
ing for linkages with related data systems, therefore. Is conceived as a part 
of MISOE development. 

The Developmental Process 
« 

Phase I development of MISOE Is designed to be operational by 
September of 1973. It, is characterized as a fixed analysis inanagement Infor- 
mation system as described In this and preceding documents. Phase M develop- 
ment will occur largely during the last contract year, and provide a variable 
analysis potential. Phase II development Vll U place con^itderable emphasis 6n 
simulation and "on line" vart&bte analysis. Occasional Paper #2 has focused 
on Phase I development. 
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During the first eight months of Phase 1 development, each task 
described In this paper will be appropriately resolved, consistent with 
. Phase I objectrvds. Task resolution will take the form of Occasional Papers 
by the consultant and permanent staff, which are a function of Interactions 
"amdng and wtthin these groups". These Occasional Papers will form the basis 
for MISOE Phase I development, which will occur ani be field tested during 
school year 1972-73. Cons fderat ions and materials for Implementation of Phase 
I will occur during school year J 972-1973. Phase II development is scheduled 
to commence during the 19^72-1973 sdhool year, with the total system operational 
by June of 1974. . . " ■■ 

This paper Includes zi listing and schedule for Phase I Occasional 
Papers, as well as a schedule for the February 16th conference (See 
Appendix A). 
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SCHEDULE 

PLANNING CONFERENCE 
t=^SE 1 



Manageinent and Information System for Occupational Education 



Division of Occupational ^Education 



Winchester, Massachusetts 



Wednesday, February 16, 1972 through Friday, February 18, 1972 



Participants - 
Martin P. Breslow 
Wl 1 1 lam G. Conroy, Jr. 
John A. Creager 

Gerald T* Downey 

Jacob J. Ka^ufman 



David V* TIedeman 



Elizabeth Weinberger 



Research Associate, MISOE 

Principal investigator, MISOE 

Research Associate, Office of Research, 
American Council on Education, Washington, D.C. 

Associate Professor, Lowell Technological 
Institute, Lowell, Massachusetts 

Director and Professor of Economics, 
Pennsylvania State 'Uhlverslty, Institute for 
Research on Human Resources, 407 Graduate 
Bui Iding, University Park, Pennsylvania 

Director, Institutes for Research In Education, 
American Institutes for Research, Palo Alto, Calif. 

Research Associate, MISOE 
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9:30 - 10:00 




--} 

r 



-Wednesday^ February I^^ 1972 

)tornlng 

9:00 9:30 "Expectations" 

WHI 1am G. Conroy, Jr. 



"Space Differentiations and Variable Setection*'- 
Ellzabeth Weinberger 



- ja:30 



"A Very Tentative. Computer Model" 
Martin P. Breslow 



10:30 - 10:45 



10:45 - 11:15 



- 11:30 



Coffee 



Afternoon 



"A Pfamework for Discussing Analysis" 
Wl I Ham Conroy, Jr. 



Discussion 



Chaired by William G. Conroy, Jr, 



TTl sessions from here on are discussion] 
oriented, with guiding chairman, except 
fof Friday, February 18, 11:15 - I2:00> I 



:30 - 2:15 



2:15 - 3:00 



3:00 - 3:20 



3:20 - 4:30 



"Non-Economfc Analysis Perceptions" 
John .A*' Creager 

"Econortric Analysis Perceptions" 
Jacob J. Kaufman 

Coffee 



'•Non*-Economf c and Economic Analysts In Tandem" 
David V, TIedemen 

in 
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Thursday^ February 17, 1972 
Morntng 

9:00 - 10:15 "Simulation and Analysis" 



10:15 - 10:30 



10:30 - I 1:00 



11:00 - I2i00 



Mar+tn Breslow 



Coffee 



"ln5+rurr»en+atlon and Ana lysis" 
Elizabeth Welnberg«r 

"The Implications of Marginal Analysis" 
Gera Id !• , Downey 



Afternoon 



:30 - 3:30 



3:30 - 3:45 
3:45 - 4:30 



"A Reconsideration of Space Differentiations, 
Variable Selection and the 'Computer System' 
in View of Analysts." 



David V. TIedeman 



Coffee 



^Unresolved Analysis Questions" 
John At Creager 



Iv 



S7 



• 












* 




♦ 

Friday, February 18 


, 1972 










Morning 












9:00 - iOj30 




'•Focus on Simulation^* 












a. Explicit projections 












b. Other data required 






* 


10:30 - 10:45 




* 

c. Analysis 

Jacob Kaufman 

Coffee 






* 


10:45 - ll:!5 


• 

*- 


"The Total Computer System - Problems 
Resolved and Unresolved" 








11:15 - 12:00 
Fun Schtduld 




Martin Breslow 
"Specific Assignments" 

Wll 1 t>am Conroy, Jr, 
-LUNCH- ^ 

« 








1. Wednesday 6venlng-+ennfs-!f any takers, and dinner at Colonial, 




• 




2* Thursday, 
% 


dinner 


In Boston • 
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OCCASIONAL PAPERS 





Title ' 


Author(s)* 


Due Date 




i. 


Population and Sample Relationships 


;Wi 1 1 lam G. Conroy/ Jr. 


February 7, 1972 




2. 


Task Different fat Ions 


WI 1 1 lam 6, Conroy, Jr. 


February 7, 1972 




3. 


A Very Preliminary Computer 
System Model 


Martin P. Bresiow 


February 16, 1972 




4. 


* 

Process Space Differentiations 


Liz Weinberger 


February ^6, 1972 




5. 


Total Space Differentiations 

* J" 


Liz Weinberger 
Gerald T, Downey 


March 1, 1972 


m 


6. 


A Classification System for Total 
System Space Which Considers 
Instruments and Variables 

ff 1 Ml III OpauU 


Martin P. Bresiow 


* 

March 30, 1972 
■» * 






Non-Economic Analysis by Non-*- 

SImiilatlOn and Simulation Data 
, Types for AH Analysis Levels 
for A 1 1 Data 


John A. Creager 


March 30, 1972 




8. 


Economl^LAaaiysis^i>^^ — - 


Jacob J,-4<auima4* . 


— Ma4=cV-30,-l^72 


— 




Simulation and Simulation Data 
Types for All Analysis Levels 
for All Data 






• 


9. 


Non-Economic Analysis by Non- 
Simulation and Simulation Data 
Types for Al 1 Analysis Levels 
for Al I Data . 

. * . A . 


David V. Tiedeman 

• 
♦ 


March 30, 1972 


« 


10. 


Psychological Instrumentation and 
Analysis ^ 


David V* Tiedeman 
* 


March' 30, 1972 
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APPENDIX A (Continued) 



Author(s) 



Due Date 



15. Ana-ly%ls Specifications 



WI 1 1 fam G, Conroy, Jr, 
Gerald T. Downey 
Others As Requested 



May 30, 1972 



I4« A Less Tentative Phase I 
Cofnputer System 



Martin P. Breslow 



May 30, 1972 



15. Other Data Requi rernents 



William G. Conroy, Jr. May 30, 1972' 



16. Phase I Simulation 



Martin P, Br.eslow 



May 30, 1972 



1 17. Phase I Development Schedule WllHamG* Conroy, Jr. June 30, 19^2 
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